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Abstract. We briefly review two different methods of applying Lie group theory in 
the numerical solution of ordinary differential equations. On specific examples we show 
how the symmetry preserving discretization provides difference schemes for which the 
3 . " first differential approximation" is invariant under the same Lie group as the original 

ordinary differential equation. 
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Dedicated to Professor Miloslav Havlicek on the occasion of his 75 birthday. 

1. Introduction 

Lie group theory provides powerful tools for solving ordinary and partial differential 
equations, specially nonlinear ones P-[3]. The standard approach is to find the Lie point 
symmetry group G of the equation and then look for invariant solutions, i.e. solutions 
that are invariant under some subgroup Go C G. For Ordinary Differential Equations 
(ODE's) this leads to a reduction of the order of the equation (without any loss of 
information). If the dimension of the symmetry group is large enough (at least equal 
to the order of the equation) and the group is solvable, then the order of the equation 
can be reduced to zero. This can be viewed as obtaining the general solution of the 
equation, explicitly or implicitly. 

However, for an ODE obtaining an implicit solution is essentially equivalent to 
replacing the differential equation by an algebraic or a functional one. From the point of 
view of visualizing the solution, or presenting a graph of the solution, it maybe easier 
to solve the ODE numerically than to do the same for the functional equation. 

For Partial Differential Equations (PDE's) symmetry reduction reduces the number 
of independent variables in the equation and leads to particular solutions, rather then 
the general one. 

Both for ODE's and PDE's with nontrivial symmetry groups it may still be 
necessary to resort to numerical solutions. The question then arises of making good 
use of the group G. Any numerical method involves replacing the differential equation 
by a difference one. In standard discretizations no heed is paid to the symmetry group 
G and some, or all of the symmetries are lost. Since the Lie point symmetry group 
encodes many of the properties of the solution space of a differential equation, it seems 
desirable to preserve it, or at least some of its features in the discretization process. 

Two different methods for incorporating symmetry concepts into the discretization 
of differential equations exist in the literature. One was proposed and explored by Shokin 
and Yanenko [IHH] for PDE's and has been implemented in several recent studies ^^U\ . 
It is called the differential approximation method and the basic idea is the following. A 
uniform orthogonal lattice in Xj is introduced and the considered differential equation 

E(f, U,Ua;,,Ma;„Xj, ■ ■ ■) = O5 (l) 

is approximated by some difference equation E'^ = 0. The derivatives are replaced by 
discrete derivatives. All known and unknown functions in ([T]) are then expanded in 
Taylor series about some reference point (x), in terms of the lattice spacings. In the 
simplest case of 2 variables, x and t, we have a = Xn+i — Xn, t = tn+i — tn 

E^{x, t, u, A^M, Atu, A^^u, Attu, A^tu, ■ ■ ■) = (2) 

= E + aEi + TE2 + a^E^ + 2aTEi + t'^E^ ^ . 

The expansion on the right hand side of (I2l) is a "differential approximation" of the 
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difference equation 

E^ = 0. (3) 

The "zero order differential approximation" of ([3]) is the original differential equation 
([1]) and hence is invariant under the symmetry group G. Keeping terms of order a 
or r in ([2]) we obtain the first differential approximation, etc. The idea is to take a 
higher order differential approximation, at least the first order one, and require that 
is also invariant under G, or at least under a subgroup Gq C G. This is done by 
constructing different possible difference schemes approximating eq. ([T]) and choosing 
among them the one for which the first (or higher) differential approximation has the 
"best" symmetry properties. 

The second approach, the invariant discretization method is part of a program 
devoted to the study of continuous symmetries of discrete equations, i.e. the application 
of Lie groups to difference equations [HHSlj. As far as applications to the numerical 
solutions of differential equations are concerned, the idea, originally due to Dorodnitsyn 
[121 [13], is to start from the differential equation, its symmetry group G and the 
Lie algebra L of G, realized by vector fields. The differential equation can then be 
expressed in terms of differential invariants of G. The differential equation is then 
approximated by a finite difference scheme that is constructed so as to be invariant 
under the same group G as the differential equation. The difference scheme will consist 
of several equations establishing relations between points in the space of independent and 
dependent variables. These equations determine both the evolution of the dependent 
variables and the form of the lattice. The equations are written in terms of group 
invariants of the group G acting via its prolongation to all points on the lattice (rather 
then to derivatives of the dependent functions). As pointed out by P. Olver this amounts 
to prolonging the group action to "multi-space" for difference equations [21] rather then 
to "jet space" as for differential equations [25j. 

The purpose of this article is to compare the two different methods of incorporating 
Lie symmetries into the numerical analysis of differential equations. For simplicity 
we restrict ourselves to the case of ODE's and analyze difference schemes that were 
used in recent articles [261428] to solve numerically some third order nonlinear ODE's 
with three or four dimensional symmetry algebras. In this article we take invariant 
difference schemes (on symmetry adapted lattices) and construct its first differential 
approximation. We then verify that in all examples this first differential approximation 
is invariant under the entire symmetry group G. 

2. Differential approximations of ordinary difference equations and 
invariant discretization of ODE's. 

Let us consider the case of a third order ODE 

E^E{x,y,y',y",y'") = 0, (4) 
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(the generalization to order n > 3 is straightforward). We can approximate (jlj) on a 4 
point stencil with points (xfc, y^), {k = n — l,n,n + l,n + 2). Alternative coordinates on 
the stencil are the coordinates of one reference point, say (x„, yn), the distances between 
the points, and the discrete derivatives up to order 3, 

(1) (1) 

(1) _ Vn+l - Vn (2) _ ^ Pn+2 " Pn+l 

Pn+1 ~ _ 5 Pn+2 ~ '^ _ 1 

■^n+l •^n •^n+2 ■^n 

A3) _ oPn+3~Pn+2i 
Pn+3 ~ *-" „ _ ™ J ■ 

The one dimensional lattice can be chosen to be uniform and then 

hn+i = K = h, (6) 

or some other distribution of points can be chosen. 

The Lie point symmetry group G transform the variables (x, y) into (x, y) = 
{A{x,y),Q{x,y)) and its Lie point symmetry algebra L is represented by vector fields 
of the form 

Xf, = C^{x, y)dx + (l)f,{x, y)dy, I < fi < dimL. (7) 

The vector fields must be prolonged in the standard manner [1] to derivatives 

prX^ = X^ + r (x, y, y,)dy^ + (8) 

+ <!>'''' {x,y,yx,yxx)dy^^ + ■••, 

when acting on a differential equation, or to all points when acting on a difference 
scheme [l5l[T8l[20] 

pr^^M = Yl [^^^(^i^yi)^^^ + (t>^l{xi,yi)^y^ , (9) 

i 

In the differential approximation method we start with a difference equation, usually on 
a uniform lattice (jH]) 

E^{Xn, K+U hn+2, Vn, Pnll^ PnU^ PnU) = 0> (10) 

and expand it into a Taylor series in the spacing h: 

E^ = Eo + hEi + h^e2 + --- = 0. (11) 

For any difference equation approximating the differential equation Eq = the lowest 
order term will be invariant under the group G. Different schemes (TTOl) can then be 
compared with respect to the invariance of the first differential approximation 

Eo + hEi = 0, (12) 

or of some higher order differential approximations. Better results can be expected for 
schemes from which flT2|) is invariant under all of G or under some subgroup Go C G 
that is relevant for the problem. 

When studying the invariance of (TT2|) it must be remembered that the prolongations 
of X^ also act on the lattice parameters h. 
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In the invariant discretization method one constructs an invariant difference scheme 

^a \^n,yn,hn,hn^l,hn+2,yn, (13) 

Pn+l^Pn+2^Pn+3) ~ U, a =1,2 

piX.E^ = 0. (14) 

The two equations (fT3|l determine both the lattice and the difference equation. Both are 
constructed out of the invariants of the group G prolonged to the lattice as indicated 
in eq. (IT^ . Thus, the difference scheme is by construction invariant under the entire 
group G acting on the equation and lattice. In the continuous limit we have 

E^ = E + KE^^^ + K+iEf^ + K+2Ef^ + h.o.t., (15) 

^2^^ = + KE'i^ + K+iE'i^ + K+2Ef + h.o.t.. (16) 

The terms spelled out in ( IT5l) correspond to the first differential approximation. 

Since the left hand side of flT5l[T6l) is invariant under G, the series on the right hand 
side must also be invariant. This does not guarantee that the first (or n-ih) differential 
approximation will be invariant. In the next three sections we will show on examples 
that the first differential approximation is indeed invariant. Thus, choosing an invariant 
difference scheme guarantees, at least in the considered cases, that the aims of the 
differential approximation method are fully achieved. 

The examples are all third order ODE's with 3 or 4 dimensional symmetry groups. 
In each case we write an invariant difference scheme of the form (fT3|) and its first 
differential approximation (ITSl) . The terms E{ \ [k = 1,2,3) in (ITSl) are differential 
expressions containing y'" and y"" . These expressions will be simplified by removing y'" 
and y"", using the ODE (jlj) and its first differential consequence. 

3. Equations invariant under the similitude group Sim{2). 

Let us consider the group of translations, rotations and uniform dilations of an Euclidean 
plane. Its Lie algebra sim{2) is realized by the vector fields 

9 - (9 - d d 

Xi = — , X2 = — , X, = y—-x—, (17) 

ox ay ox Oy 

<r d d 

Xa = X—- + y--, 
ox oy 

This group has no second order differential invariant and precisely one third order one, 
namely |26] 



^ _ (1 + y'')y"' - 3y'y 

y"" 

The expressions 



'„."2 

- ^y 

1/2 



;i8) 



J ^ y" J ^ {l + y^)y"'-?>y'y"' 

'1 (1+^/2)3/2' ^2 (l+y'2)3 ^'^> 
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are invariant under the Euclidean group, with Lie algebra {Xi, X2, X^}, but only the 
ratio I2/I1 = / is invariant under dilations. 

Thus the lowest order ODE invariant under Sim{2) is 

(1 + y'')y'" - 3y'y"' = Ky"' (20) 

where K is an arbitrary constant. 

To discretize ( l20l) (or any third order ODE) we need (at least) a four-point 
stencil. The Euclidean group has 5 independent invariants depending on 4 points 
{xn+k, Vn+k), k = -1, 0, 1, 2 namely f26] 

2-t 1/2 



^1 — hn+2 
^2 = hn+1 



1 + 



yn+2 - yn+i 



h 



1 + 



n+2 



yn+i - yn 



h 



n+1 



6 = K 



1 + 



Vn - Vn-l 



2-1 1/2 



1/2 



(21) 



^4 = (l/n+2 - yn+l)hn+l - (Z/n+1 - l/n)/in+2, 
^5 = (|/„+i - yn)hn - ijjn " yn-l)hn+l- 

Out of them we can construct 4 independent Sim{2) invariants, for instance 

2aU . 2/3^5 



Ji 



J, 



66(6 + 6) (66)(6 + 6) 

a + (3 = 1. 

6 / 6 



(22) 



6 



6 + 6 + 6V66(6 + 6) 66(6 + 6) 

and the two ratios 6/6; 6/6- To obtain the continuous limit we put 

Xn—\ Xn IT'Ti) -^n+l -^n ~r "-n+l; 1^*^/ 

2^n+2 = 2;„ + rt-n+l + hn+2-, 

Vn+k = y{Xn+k), K+k = ttfce, ttfc ~ 1, 

and expand yn+k into a Taylor series about x„ = x. 

The invariants Ji, J2 where so chosen that their continuous limits are Ji and I2 
respectively. 

The invariant scheme used in j26] to solve the ODE ( l20l) numerically was 

0, (24) 



^^2'' = 66-^2 



E 



J2 - KJl = 0. 



The first differential approximation of fl24|) is 

^2^ ^ 2(-/l2^1 + Khn+2){y" + 1) + 

+ (2/in^n+l^n+2 ~ 2/l„^-^ — h^hn+2 + 
+ /^n/i^+2)l/V' = 



(25) 
(26) 
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Applying pr^Xj to eq. (12B]) we find that the equation is invariant under the entire group 
Sim{2), as are the terms of order e^ and e'^ separately. 

The first order differential approximation of the difference equation ( l25l) is quite 
comphcated. However, if we substitute the ODE (120|) and its differential consequences 
into the first nonvanishing term of the approximation, we obtain a manageable 
expression 

E^ ^ (1 + y'')y"' - 3yY' - Ky"' - (27) 

X |ir2[16a(/i„ + K+i + K+2f + 

- 4:hl - 12hl^2 - 8/i^+i - 16hnhn+2 - 

— 20hn+lhn+2 + 12/in^n+l] + 
+ 9hn+l{hn+2 - K)\ = 0. 

Expression (j27j) also satisfies 

pr^X.Ef =0 ^ = l,---,4 (28) 

SO the first differential approximation of the entire scheme (I24II25P is invariant under 
Sim{2). 

4. Equations invariant under a one dimensional realization of S'L(2,]R). 

Four inequivalent realizations of s/(2,R) by vector fields in two variables exist |29j . 
Invariant difference schemes for second and third order ODE's have been constructed 
and tested for all of them [2SH2S]- In this section we shall consider the first one, called 
s/i(2,M), or alternatively s/y(2,M), which actually involves one variable only: 

^1 = 1-' ^2 = 2/|-, ^3 = 1/' I". (29) 

oy oy ay 

The corresponding Lie group acts by Mobius transformations (fractional linear 
transformations) on y. The third order differential invariants of this action are the 
Schwarzian derivatives of y and the independent variable x. The most general third 
order invariant ODE is 

j-2{y'y"'-ly"')=F{x). (so) 

where F{x) is arbitrary. For F{x) = K = const the group is GL(2,]R) and ( !29l) 
is extended by the vector field X4 = d^- For F{x) = the symmetry group is 
SLy{2,R)0SL^{2,R). 

The difference invariants on a four point stencil are 

p_ {yn+2-yn){yn+i-yn-i) ^ h h h ('^^^ 

[yn+2 - yn+l)[yn - Vn-l) 
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The discrete invariant approximating the left hand side of (I5U]) is 

T _ Qhn+2hn /02^ 

hn+l{hn+l + hn+2){hn + ^n+l)(^n+2 + ^n+1 + ^n) 



X 



{hn+2 + ^n+l)(^n+l + ^n) _ p 



^n^n+2 

Any lattice depending only on x^ will be invariant, in particular the lattice equation 
can be chosen to be 

Xn+l - IXn + Xn-\ = 0. (33) 

The general solution of fl33l) is 

Xn = n/i + Co, (34) 

i.e. a uniform lattice with origin xq and spacing Xn+i — Xn = h. 
Let us consider the invariant ODE 

j^{y'y"'-ly"'^=s^nix). (35) 

and approximate it on an a priori arbitrary lattice. Such a scheme is given by 

E^ = Ji- sm(0 = 0, (36) 

^ = Xn + ahn + bhn+1 + chn+2, 

0(x„, hn, hn+i, hn+2) = 0, (37) 

where a, b, c are constants and (p satisfies the condition 

0(x„, 0,0, 0)^0, (38) 

(for instance (p can be linear as in fl33l) . The first differential approximation of (|36|) . 
after the usual simplifications, is 

^0 ^ ^ {y'y'" - ly"') - stn{x) + (39) 

+ cos{x){K{l + 4a) - 2 * K+iil - 2b) - 

- /i„+2(l-4c)}. 

Eq. (139!) is invariant under SLy{2,'R). Moreover, if we choose 

1,11 
^ = -4, ^=2' c=4' (40) 



the second term in ( 1391) vanishes completely and -Eq = is a second order approximation 
of the ODE f p5|l . We mention that the uniform lattice (^^, used in [.26] satisfies (HOj) . 

5. Equations invariant under a two-dimensional realization of GL(2,M). 

A genuinely two-dimensional realization of the algebra gl{2,M.) is given by the vector 
fields 

(9 - d d 

Xi = — , X2 = x—+y—, (41) 

oy ox oy 

d 2 ^ - d 

A3 = 2xy^- + y ^-, A 4 = X-—. 
ox oy ox 
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The S'L(2,M) group corresponding to {Xi,X2,X^} has two differential invariants of 
order m < 3: 



^ 2xy" + y' ^ x\y'y"'-?>y 

-'1 — 77^ 5 -'2 — 



"2^ 



y"i 



y 



(42) 



The expression h/Ii is also invariant under the dilations generated by X4 and hence 
under GL{2,'R). The corresponding ODE invariant under GL(2,]R) is 

li = A'l^ 

which is equivalent to 

E = x\y'y"' - 3y'y - A'y'{2xy" + y'f = 0. 

Five independent SL{2, M) difference invariants are 
1 



6 
6 



:{yn+2 -Vn+l), 



yJXn+lXn+2 

(Z/n+1 -|/n), 



(43) 
(44) 

(45) 



yjXfiXn^X 
6 = {Vn - yn-1 



e 



1 



iyn+2-yn), 



^XfiXfij^l 
^5 = (l/n+1 - Z/n-l)- 

Any 4 ratios of ^i/^fc will be GL{2, M) invariants. The SL{2, M) invariants that have the 
correct continuous limits are 



J2 



Ji = 8 



12 r e4-ei-6 

e2(6 + e2 + e3)Ui(ei + e2) 
^5 — ^2 — ^3 " 

6-6-6 



(46) 



a 



66(6 + 6) 



+ (l-a) 



6 — 6 — 6 
66(6 + 6; 



(47) 



The difference scheme for the ODE (l44l) with A = —1 used in Ref. [26] was actually the 
square root of ( H3l) . equivalent to 

^f = J2 + 4 



0, 



E'^ = -^ = 7 = const. 
6 

The first differential approximation of the lattice equation fB9|) is 

E(^^ ^ (7/in+l - hn+2)y' + 

^{[-7^n+l + hn+2{hn+2 + 2/l„+i)]y' + 

+ xy"[-fhl_^^ - /i„+i/i„+2 - /i^+2]} = 0. 



(48) 
(49) 

(50) 
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Both terms in (I3U]) are invariant under GL{2^M). 

The first differential approximation to the difference equation P8|) is 

X /i2(32a -11) + 16/1^^+1 (2a -1) + 
+ /i^+2(32a - 21) + KK+i{Ua - 21) + 
+ 32/i„/i„+2(2a - 1) + /i„+i/i„+2(64a - 43) 

The second term of expression (15T!) has been simphfied using ( 144|) and its differential 
consequences. Again, (ISTl) is invariant under the entire 6*17(2, M) group. 

6. Conclusions 

The three examples considered above in Sections 3, 4 and 5 confirm that the method of 
invariant discretization provides a systematic way of constructing difference schemes for 
which the first differential approximation is invariant under the entire symmetry group 
of the original ODE. 

The two equations (1131) determining the invariant difference scheme for an ODE 
are not unique since there are more difference invariants than differential ones. The 
differential approximation of an invariant scheme can be used to benefit from this 
freedom and to choose an invariant scheme with a higher degree of accuracy. An example 
of this is given in Section 3, eq. ( !39|) where the choice of the parameters (140|) assures 
that the terms of order e in ( l39l) vanish identically. 

Previous numerical comparison between invariant discretization and standard 
noninvariant numerical methods for ODE's [261 - I28] have shown two features. The first 
is that the discretization errors for invariant schemes are significantly smaller [26] (by 
3 orders of magnitude for eq. (ITSl) . 1 order of magnitude for eq. (HI])). The second 
feature is that the qualitative behaviour of solutions close to singularities is described 
much more accurately by the invariant schemes [261428] . 

An analysis of the relation between invariant discretization and the differential 
approximation method for PDE's is in progress. 
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